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[57] ABSTRACT 

Image processing apparatus is described in which a 
source stream of data captured by a particular source is 
passed through a data splitter where it is split using one 
splitting technique into a plurality of split streams of 
data. These split streams of data each contain only part 
of the information within the source stream of data. The 
split streams of data are separately manipulated by a 
post production unit prior to being passed through a 
data combiner where they are recombined to form an 
output stream of data. The source stream of data and the 
output stream of data are of a higher resolution than the 
individual split streams of data. The post production 
unit includes at least one reformatter for reformatting 
the data stream to use a different splitting technique 
matched to the manipulation being performed in the 
post production unit. 

14 Claims, 12 Drawing Sheets 
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APPARATUS AND METHOD FOR PROCESSING 
IMAGE DATA 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to the processing of image data. 

2. Description of the Prior Art 

The processing of image data is a well established 
technical field. Image data can be captured in many 
different forms. For example, image data may be cap- 
tured by still/moving image photographic cameras or 
still/moving image electronic cameras. Once the image 
data has been captured, it is typically transformed into a 
stream of data according to a known image data format, 
such as PAL, NTSC, SECAM or SMITE 240M. 

There exist many different pieces of equipment for 
performing manipulations upon image data in the afore- 
mentioned formats. The manipulations can take many 
different forms. For example, the manipulation may be 
recording onto magnetic tape, processing through a 
digital video effects system, motion compensated stan- 
dards conversion or spatial filtering. 

As the technical field of the capture, manipulation 
and reproduction of image data has advanced, this has 
made possible the use of increasingly high resolution 
systems. At the present time this technical field is at the 
start of a transitional period between the use of formats 
such as PAL, NTSC and SECAM and the use of a new 
generation of high definition of video formats. 

A major obstacle that stands in the way of such evo- 
lution is the vast amount of investment and develop- 
ment effort that must be expended to produce apparatus 
for manipulating data in these new higher resolution 
formats. As spatial and temporal resolution increases 
the rate at which image data must be handled increases 
to an extent that the sophistication of the equipment 
used must be significantly increased so as to cope. This 
is a hugely expensive undertaking. 

One possible way in which the use of higher resolu- 
tion formats may be facilitated is to split the source 
stream of data into a number of separate split streams of 
data each having only part of the information content of 
the source stream of data. The lowering of the informa- 
tion content of the split streams of data may be sufficient 
to allow existing or slightly modified equipment, origi- 
nally designed for use with lower resolution formats, to 
be employed. This technique can be thought of as pro- 
viding a hierarchial philosophy in which systems of 
increased resolution can be built from combining pieces 
of equipment that were originally produced for lower 
resolution operation. 

Whilst the above is a superficially attractive ap- 
proach, it brings with it its own set of problems which 
must be solved if its use is to be practical. In particular, 
the splitting, manipulation and combining of the data 
can introduce distortions into the image data that did 
not occur, or were not relevant, when the lower resolu- 
tion equipment was being used upon data in the format 
for which it was originally intended. 

It is an object of the invention to provide apparatus 
for processing image data adopting the above described 
hierarchial philosophy that has a reduced level of dis- 
tortions due to the splitting, manipulation and combin- 
ing of the data. 



SUMMARY OF THE INVENTION 

The invention provides apparatus For processing 
image data, said apparatus comprising: 
S (i) an image data source for generating a source 
stream of data representing an image; 

(ii) a data splitter for splitting said source stream of 
data into a plurality of split streams of data each 
representing a part of the information content of 

10 said source stream of data; 

(iii) manipulation means for performing a manipula- 
tion upon said plurality of split streams of data; and 

(iv) a data combiner for combining said plurality of 
split streams of data into an output stream of data; 

15 wherein 

(v) said manipulation means includes at least one 
reformatter for reformatting said plurality of split 
streams of data such that the information content of 
said source stream of data is split between said 

20 plurality of split streams according to a different 
technique that is matched to a manipulation to be 
applied to said plurality of split data streams. 
The invention both recognizes and solves the prob- 
lem that differing ways of splitting the image data are 
25 suited to some, but not other, forms of manipulation 
prior to recombination. The provision of a system in 
which the manipulation means includes at least one 
reformatter greatly increases the versatility of the sys- 
tem whilst only incurring a minor increase in complex- 
30 ity. 

It will be appreciated that the data splitter and data 
combiner may use many different splitting techniques. 
An 'ad hoc' approach could be used to provide what- 
ever interfaces were needed between different items of 

35 manipulation apparatus so as to change the data split- 
ting format This would however cause problems by 
preventing a uniform approach to monitoring the signal 
at different points along the processing chain. 
A better approach is to provide a uniform format for 

40 the exchange of data between manipulation apparatus 
and then provide each manipulating apparatus requiring 
other than this uniform format with reformatters at its 
input and output to reformat out of and then back in to 
the uniform format. The differing splitting techniques 

45 that may be used each have associated advantages and 
disadvantages. Splitting the data by sub sampling is 
simple to implement, but the monitor signals are gener- 
ally not of high quality. Splitting the data by tiling is still 
relatively easy to implement and has the advantage that 

50 standard concealment of errors can be used, but has the 
disadvantage that monitoring is not that straight for- 
ward and edge effects may be visible upon recombina- 
tion. 

In preferred embodiments of the invention said data 
55 splitter includes means for splitting said source stream 
of data into a plurality of streams of two dimensional 
spatial frequency sub band data and said data combiner 
includes means for combining said plurality of streams 
of two dimensional spatial frequency sub band data to 
60 form said output stream of data. Splitting the data on a 
spatial frequency basis can be achieved by using rela- 
tively simple and inexpensive filters. Furthermore, since 
each sub band has its edge corresponding to the edge of 
the full image, this approach is not prone to introducing 
65 edge effect errors into the central part of the recon- 
structed image. 

The sub band splitting technique is particularly suit- 
able when said manipulation means includes an image 
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data recorder for separately recording said plurality of The invention also provides a method of processing 

streams of two dimensional spatial frequency sub band image data, said method comprising the steps of: 

data and monitor means for reproducing a monitor (i) generating a source stream of data representing an 

image during partial replay from that stream of two image; 

dimensional sub band data having the lowest two di- 5 (ii) splitting said source stream of data into a plurality 

mensional spatial frequencies. The monitoring of the of split streams of data each representing a part of 

image is of critical importance when carrying out tasks the information content of said source stream of 

such as editing with manipulations from a digital video data; 

effects unit and this feature allows one of the recorded (iii) reformatting said plurality of split streams of data 

channels to be used to provide a good quality monitor 10 such that the information content of said source 

image. stream of data is split between said plurality of split 

In particularly preferred embodiments of the inven- streams of data according to a different technique 

tion said data splitter is operable to provide that stream that is matched to a subsequent manipulation; 

of two dimensional sub band data having the lowest two (iv) performing a manipulation upon said plurality of 

dimensional spatial frequencies with a signal format IS split streams of data; and 

suitable for direct reproduction by a television receiver. (v) combining said plurality of split streams of data 

This feature allows the sub band data having the lowest into an output stream of data, 

two-dimensional spatial frequencies to be directly The above, and other objects, features and advan- 

tapped and displayed upon a conventional television tagesof this invention will be apparent from the follow- 

receiver. This monitor image will be of a lower resolu- 20 ing detailed description of illustrative embodiments 

tion than the source stream of data, but it is quite suffi- which is to be read in connection with the accompany- 

cient for the function of locating particular points ing drawings, 
within an image data stream. 

Whilst sub band splitting has advantages in circum- BRIEF DESCRIPTION OF THE DRAWINGS 

stances such as those described above, it suffers from 25 FIG. 1 illustrates a non real time system for manipu- 

the limitation that any manipulation that alters the spa- lating image data with equipment originally designed 

tial frequency of any of the data in the split streams of for manipulating image data of a lower information 

data would introduce a gross distortion on recombina- content; 

tion. Furthermore, any manipulation involving spatial FIG. 2 illustrates a real time system for manipulating 
filtering would have a disadvantageously decreased 30 image data with equipment originally designed for ma- 
resolution due to the decreased spatial resolution of the nipulating image data of a lower information content; 
individual split streams of data upon which it would FIGS. 3 and 4 illustrate a sub band splitting tech- 
operate, nique; 

Accordingly, in preferred embodiments of the inven- FIG. 5 illustrates a data splitter for use with the sub 

tion said at least one reformatter includes means for 35 band splitting technique; 

reformatting said plurality of split streams of data into a FIG. 6 illustrates a data combiner for use with the sub 

plurality of streams of data each representing a different band splitting technique; 

area within an image. FIGS. 7 and 8 illustrate a tiling splitting technique; 

This reformatting recovers the full spatial resolution FIG. 9 illustrates a data splitter for use with the tiling 

within each of the split streams of data that may be 40 splitting technique or a sub sampling splitting technique; 

required for the manipulation concerned. Embodiments FIG. 10 illustrates a data combiner for use with the 

of the invention with a reformatter capable of providing tiling or sub sampling splitting techniques; 

tiled data are particularly suitable when said manipula- FIGS. 11 and 12 illustrate the sub sampling splitting 

tion means includes a spatial filtering means for per- technique; 

forming spatial filtering separately upon said plurality 45 FIG. 13 illustrates a manipulation means with refor- 

of streams of data representing different areas of an matters; 

image. FIG. 14 illustrates non real time monitoring of a data 

Another reformatting operation is provided by em- stream split with the sub band technique; 

bodiments in which said at least one reformatter in- FIG. 15 illustrates a real time monitoring of a data 

eludes means for reformatting said plurality of split 50 stream split with the sub band technique; 

streams of data into a plurality of streams of sub sam- FIG. 16 illustrates non real time monitoring of a data 

pled data. Such splitting prior to manipulation helps stream split with the tiling splitting technique: 

avoid edge effects in the centre of the picture and is not FIG. 17 illustrates a real time monitoring of a data 



subject to the rigid requirement that the spatial fre- 
quency of the split streams of data must not be altered. 

If it is desired that the manipulations should be car- 
ried out in real time, then one class of preferred embodi- 
ments provide that said manipulation means has a multi- 



stream split with the tiling splitting technique; 
55 FIG. 18 illustrates non real time monitoring of a data 
stream split with the sub sampling splitting technique; 

FIG. 19 illustrates a real time monitoring of a data 
stream split with the sub sampling splitting technique; 



channel architecture with said plurality of split streams and 
of data each being manipulated in a different channel so 60 FIGS. 20, 21 and 22 illustrate example picture manip- 
as to provide real time manipulation of said image data. ulations. 

Alternatively, if real time operation is not required, 
then preferred hardware efficient embodiments of the DESCRIPTION OF THE PREFERRED 

invention are such that said data splitter outputs a multi- EMBODIMENTS 
plexed stream of data comprising a sequence of contem- 65 FIG. 1 illustrates a system for the non real time ma- 
poraneous portions of said plurality of split streams of nipulation of image data. Various apparatus for generat- 
data, said manipulation means performing non real time ing the source stream of image data is illustrated. These 
manipulation upon said multiplexed stream of data. include: a still image photographic camera 2 and a slide 
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converter 4; a movie camera 6 and a film scanner 8; a tal and two times vertical) and has 2007 horizontal lines 
high definition moving image electronic camera 10, a each composed of 3840 pixels, 

high definition digital video tape recorder 12 and a FIG. 4 illustrates how the super high resolution frame 

video data mixer 14; and a super high resolution moving of FIG. 3 may be split into four two dimensional spatial 

image electronic video camera 16 and a super high 5 frequency sub bands. In this example, the image is split 

resolution digital video tape recorder 18 (illustrating the into low and high frequency components both horizon- 

hierarchial manner in which the system can cope with tally and vertically. Sub band 44 is the low horizontal 

increased resolution equipment developed in the fu- and low vertical frequency component Sub band 46 is 

ture). the low horizontal and high vertical frequency compo- 

The image capture of these devices takes place in real 10 nent Sub band 48 is the high horizontal and low verti- 

time. Subsequent processing in this embodiment takes cal frequency component Sub band 50 is the high hori- 

place in non real time. The factor by which the process- zontal and high vertical frequency component. It will 

ing time is reduced is approximately equal to the num- be appreciated that since the super high resolution 

ber of streams into which the data is split. frame of FIG. 3 has essentially double the horizontal 

The non real time source stream of data from one of 15 and vertical spatial frequency of a standard high defini- 

the slide scanner 4, the film scanner 8 or the video data tion video frame, the splitting by a factor of four will 

mixer 14 is fed to a respective data splitter 20. The split mean that the sub band 44 in feet represents a high 
streams of data from the data splitter 20 take the form of definition base band image. Sub band 52 is the first sub 
a multiplexed stream of data comprising a sequence of band of the next frame of image data, 

contemporaneous portions of each of the split streams, 20 FIG. 5 illustrates a data splitter 20 For sub band split* 

e.g. the image data from a single frame may be split into ting. The super high resolution source stream of data is 

four separate streams which are then output in sequence fed into a filter bank 54. In the case of non real Hmp 

from the data splitter 20. The non real time multiplexed system, this data is fed in at a J normal rate. The filter 

data streams from the data splitter 20 are recorded on a bank 54 comprises an array of finite impulse response 

high definition digital video tape recorder 22. In the 25 filters of the known type For decimating and frequency 

case of the super high resolution camera 16 and the separating the input data stream. The output from the 

super high resolution digital video tape recorder 18, the filter bank 54 is four parallel split streams of data each 

super high resolution digital video tape recorder cap- representing a different spatial frequency sub band. In 

tores the image data in real time but plays it back the case of the real time system of FIG. 2, these split 

through the data splitter 20 in non real time. 30 streams of data are fed in parallel to the multi channel 

The split data is then fed to a post production pro- post production processing system. In the case of the 

cessing unit 24. This post production processing unit non real time system they are fed to a buffer and selec- 

can be a standard piece of high definition equipment tor unit 56 where they are collected and sequentially fed 

such as a high definition video effects unit or high defi- onto the single high definition video channel for post 

nition filtering system. Alternatively, in some embodi- 35 production processing with the system of FIG. 1. 

ments the manipulation being performed could be the FIG. 6 shows a data combiner 28 for use with split 

storage on magnetic media by the high definition digital streams of data produced with the sub band splitting 

video tape recorder 22. technique. In a real time system the split streams of data 

The output from the post production processing unit are fed in parallel to a filter bank 58 where they are 
24 is fed to a further high definition digital video tape 40 combined and interpolated into a super high resolution 
recorder 26 via which it is passed to a data combiner 28. signal. For the real time system the parallel channels 
The data combiner 28 combines the split streams of data pass through a selector and buffer unit 60 without modi- 
into an output stream of data. This can then be passed fication. In the case of a non real time system the multi- 
through a super high resolution film transfer unit 30 plexed split streams of data are fed via a sequential 
onto a 70 mm film projection system 32 or direct to a 45 channel to the selector and buffer unit 60 where they 
super high resolution video channel 34. Alternatively, are fed into appropriate buffer stores for subsequent 
the combined output stream of data could be split again parallel output to the filter bank 58 during the next 
with accompanying pan/scan/zoom operations by a frame period whilst another set of buffers are receiving 
video down conversion system 36 and then displayed the split streams for that next frame, 
via a standard high definition channel 38 or placed onto 50 FIG. 7 illustrates the splitting of a super high resolu- 
35 mm film by an electron beam recorder 40. tion frame with a tiling splitting technique. Different 

FIG. 2 shows a system for the real time manipulation portions of the image Al, A2, A3 and A4 are formed in 

of image data. The difference between this system and respective quadrants. It will be seen that these quad- 

that of FIG. 1 is that between the data splitters 20 and rants overlap. This overlapping is to facilitate the re- 

the data combiners 28 there exists a multi channel archi- 55 moval of edge effect distortions when the quadrants are 

tecture comprising four post production processing subsequently recombined. 

units 24 with corresponding banks of high definition FIG. 8 illustrates the split streams of data formed 

video tape recorders 22 and 26. It will be appreciated with this tiling splitting technique. Each stream of data 

that the four post production processing units 24 must represents a respective quadrant from within the super 

have a coordinated operation and so a controller 42 is 60 high resolution frame of FIG. 7. Quadrant Bl represents 

provided to synchronise their operation. For example, if the upper left hand quadrant of the subsequent super 

the post production processing unit is performing a fade high resolution frame. 

or wipe operation then it is important that this should FIG. 9 illustrates a non real time data splitter 20 for 

progress at the same rate for each of the split streams of use with either tiling or sub sampling splitting. The 

data if distortion upon recombination is to be avoided. 65 super high resolution data is fed to a swing buffer ar- 

FIG. 3 illustrates a super high resolution frame of rangement 62. Respective frames of the super high reso- 

video data. This is approximately four times the resolu- lution data are stored in respective frame stores on ei- 

tion of current high definition video (two times horizon- ther side of the swing buffer 62. A timing circuit 64 



06/06/2002, EAST Version: 1.03.0002 



5,392,071 

7 8 

extracts the timing and synchronisation information then scaled in the digital multiple effects unit 98 prior to 
from the super high resolution signal. This timing cir- being reformatted back into sub band format by the 
cuit controls the operation of a read address generator reformatter 100. 

66 and a write address generator 68. The read address On a second channel, a background image is split into 
generator 66 and the write address generator 68 can 5 sub band format by a data splitter 102 prior to being 
comprise incrementing counters addressing appropri- stored on a video tape recorder 104. The outputs from 
ately programmed PROMs for mapping the increment- the reformatter 100 and the video tape recorder 104 are 
ing count into a predetermined sequence of addresses fed to the inputs of a keyer 106 where they are keyed 
within the frame stores of the swing buffer 62. Whilst a together in the sub band domain under the control of- a 
current frame of super high resolution data is being fed 10 keying signal prior to being combined into an output 
into one of the frame stores under control of the write data stream by a data combiner 108. 
address generator 68, the data from the previous frame A monitor 110 is provided to read the LowH, LowV 
is being read out of the other frame store under control sub band (see FIG. 4) so as to provide feedback to the 
of the read address generator 66. operator as to the results of the DME scaling and key- 

It will be appreciated that with appropriate program- 15 ing manipulations, 
ming of the PROMs the data can be read into the frame It will be appreciated that the reformatters 96, 100 
stores in its normal raster scan pattern but read out in can be constructed using the data splitters and data 
any sequence and order that is desired. For example, the combiners described above in relation to FIGS. 5, 6, 9 
data can be read out as four raster scanned quadrants in and 10. The reformatter 96 (sub band to tiled) can be 
the case of tiling splitting or in a raster scanned spatially 20 formed as a sub band combiner in series with a tiling 
sub sampled sequence in the case of sub sampling split- splitter and the reformatter 100 (tiled to sub band) as a 
ting as will be discussed later. tiling combiner in series with a sub band splitter. 

A select and control unit 70 responsive to the respec- FIG; 14 illustrates the monitoring of non real time sub 
tive read and write addresses is used to supply the ap- band split data. The sequential stream of multiplexed 
propriate signals to the control inputs of the frame 25 sub band data is selectively sampled into a frame store 
stores and to an output selector 72. 74. The sync input to the frame store 74 ensures that it 

FIG. 10 illustrates a real time version of the data is the low frequency horizontal and low frequency ver- 
splitter of FIG. 9. In this case four parallel swing buffers tical sub band data that is captured in the frame store 74. 
are provided. The splitting can take place on either the This particular sub band, as previously mentioned, rep- 
input side or output side of the frame stores. The full 30 resents a base band high definition video signal that can 
image could be written into each frame store and then be directly used to drive a standard high definition 
the appropriate pixels thereof read out under control of monitor 76. 

the predetermined sequence of read addresses. Alterna- FIG. 15 illustrates monitoring in a real time sub band 
tively, only those pixels for a particular split data stream splitting system. In this system the low frequency hori- 
could be read into each of the frame stores and then all 35 zontal and low frequency vertical sub band data be can 
of these read out in parallel with a simple incrementing directly tapped to a high definition monitor 78 with no 
read address. need for the buffering of the frame store 74 from the 

FIG. 11 illustrates a sub sampling splitting technique. non real time system. 
The pixels from a small section of a super high resolu- FIG. 16 illustrates monitoring in a non real time tiling 
tion frame are shown in magnified schematic form at the 40 splitting system. Successive quadrants of a source image 
bottom of FIG. 11. The pixels for the respective split frame are captured in a frame store 80. This captured 
streams of data are shown as o, A, V, and □. It will be data is then refUtered to remove any edge effects and 
seen that the pixels forming each of the split streams of decimated down to a high definition signal which can 
data effectively sub sample the full super high resolu- then be used to drive a high definition monitor 82. 
tion frame in a regular array. 45 FIG. 17 shows monitoring in a real time tiling split- 

FIG. 12 shows the split streams of data collected ting system. In this case the quadrants are captured in 
together. Respective split streams comprise all the o, A, parallel, but otherwise the steps of combination, refilter- 
V and □ pixels from one super high resolution frame. ing and decimation are the same. 

It will be understood that the data splitters of FIGS. FIGS. 18 and 19 respectively illustrate non real time 
9 and 10 can be readily adapted by an appropriate ad- 50 and real time monitoring in a sub sampling splitting 
dress mapping in the address generators 66, 68 to per- system. These monitoring systems are substantially the 
form the sub sampling of FIGS. 11 and 12 rather than same as those of FIGS. 15 and 16 other than the data is 
the tiling of the previous splitting technique. in a different order within each split stream. 

FIG. 13 illustrates a manipulation means For manipu- FIGS. 20, 21 and 22 illustrate possible post produc- 
lating a foreground image and keying it into a back- 55 tion manipulations that may be performed. All the im- 
ground image. A data splitter 92 splits the foreground ages are of a super high resolution format of the form 
image data stream into a series of consecutive sub band illustrated in FIG. 3. FIG. 19 has a background 83 
image as shown in FIG. 4 (sub band splitting is, in this formed of an expanded and defocused high definition 
embodiment, used as the uniform data exchange format image with a foreground image 84 subsequently matted 
between manipulation apparatus). These sub band im- 60 on at its full super high resolution, 
ages are then stored on a video tape recorder 94. It is FIG. 21 shows a super high resolution background 86 
desired that the foreground image be scaled prior to with a high definition foreground 88 matted on at its full 
combination with the background image. This scaling high definition resolution. 

will alter the spatial frequencies within the image and FIG. 22 shows a high definition image that has been 
accordingly cannot be carried out in the sub band do- 65 magnified horizontally and vertically to fill a full super 
main. To overcome this, a reformatter 96 converts the high resolution frame 90. 

data from a sub band format to a tiled format as illus- Although illustrative embodiments of the invention 
trated in FIG. 7. The output from the reformatter 96 is have been described in detail herein with reference to 
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the accompanying drawings, it is to be understood that 
the invention is not limited to those precise embodi- 
ments, and that various changes and modifications can 
be effected therein by one skilled in the art without 
departing from the scope and spirit of the invention as 5 
defined by the appended claims. 
We claim: 

1 Apparatus for processing image data, said appara- 
tus comprising: 

image data source means for generating a source 10 
stream of data representing an image; 

data splitter means for splitting said source stream of 
data into a first plurality of split streams of data 
according to a first technique, each of said first 
plurality of split streams representing a part of the 15 
information content of said source stream of data; 

first reformatter means for reformatting said first 
plurality of split streams of data into a second plu- 
rality of split streams of data according to a second 
technique different than said first technique, said 20 
second technique being matched to an image ma- 
nipulation to be applied to said second plurality of 
split streams of data; 

manipulation means for performing said image ma- 
nipulation upon said second plurality of split 25 
streams of data; and 

data combiner means for combining said second plu- 
rality of split streams of data, as manipulated, into 
an output stream of data. 

2. Apparatus as claimed in claim 1, further compris- 30 
ing second reformatter means for reformatting said 
second plurality of split streams of data, as manipulated, 
into a third plurality of split streams of data that have 
the format of said first plurality of split streams of data 
and that are combined by said data combiner means. 35 

3. Apparatus as claimed in claim 1, wherein said first 
plurality of streams of data are in the format of two 
dimensional spatial frequency sub band data. 

4. Apparatus as claimed in claim 3, wherein said ma- 
nipulation means includes image data recorder means 40 
for separately recording said first plurality of streams of 
two dimensional spatial frequency sub band data and 
monitor means for reproducing a monitor image during 
partial replay of a stream of recorded two dimensional 
sub band data having the lowest two dimensional spatial 45 
frequencies. 

5. Apparatus as claimed in claim 3, wherein said data 
splitter means is operable to provide that stream of two 
dimensional sub band data having the lowest two di- 
mensional spatial frequencies in a signal format suitable 50 
for direct reproduction by a television receiver. 

6. Apparatus as claimed in claim 1, wherein each of 
said second plurality of split streams of data represents 
a different area within said image represented by said 
source stream of data. 55 

7. Apparatus for processing image data, said appara- 
tus comprising: 

image data source means for generating a source 
stream of data representing an image; 

data splitter means for splitting said source stream of 60 
data into a first plurality of split streams of data 
each representing a part of the information content 
of said source stream of data according to a first 
technique; 

manipulation means for performing a manipulation 65 
upon said first plurality of split streams of data, said 
manipulation means including at least one refor- 
matter for reformatting said first plurality of split 



071 

10 

streams of data into a second plurality of split 
streams of data in which the information content of 
said source stream of data is split according to a 
second technique that is matched to a manipulation 
to be applied to said second plurality of split 
streams of data, said second technique being differ- 
ent than said first technique, said at least one refor- 
matter including means for reformatting said first 
plurality of split streams of data into said second 
plurality of split streams of data each representing 
a different area within an image, said manipulation 
means also including spatial filtering means for 
performing spatial filtering separately upon said 
second plurality of streams of data representing 
different areas of an image; and 
data combiner means for combining said second plu- 
rality of split streams of data, as spatially filtered, 
into an output stream of data. 

8. Apparatus as claimed in claim 1, wherein said sec- 
ond plurality of split streams of data are in a format of 
streams of sub sampled data. 

9. Apparatus for processing image data, said appara- 
tus comprising: 

image data source means for generating a source 
stream of data representing an image; 

data splitter means for splitting said source stream of 
data into a first plurality of split streams of data 
each representing a part of the information content 
of said source stream of data according to a first 
technique; 

manipulation means for performing a manipulation 
upon said first plurality of split streams of data and 
including at least one reformatter for reformatting 
said first plurality of split streams of data into a 
second plurality of split streams of data in which 
the information content of said source stream of 
data is split according to a second technique that is 
matched to a manipulation to be applied to said 
second plurality of split streams of data, said sec- 
ond technique being different than said first tech- 
nique, said manipulation means having a multi- 
channel architecture with said first plurality of split 
streams of data each being manipulated in a differ- 
ent channel so as to provide real time manipulation 
of said image data; and 

data combiner means for combining said second plu- 
rality of split streams of data, as manipulated, into 
an output stream of data. 

10. Apparatus for processing image data, said appara- 
tus comprising: 

image data source means for generating a source 
stream of data representing an image; 

data splitter means for splitting said source stream of 
data into a first plurality of split streams of data 
each representing a part of the information content 
of said source stream of data according to a first 
technique and for outputting a multiplexed stream 
of data comprising a sequence of contemporaneous 
portions of said first plurality of split streams of 
data; 

manipulation means for performing non real time 
manipulation upon said multiplexed stream of data 
and including at least one reformatter for reformat- 
ting said multiplexed stream of data into a second 
plurality of split streams of data in which the infor- 
mation content of said source stream of data is split 
according to a second technique that is matched to 
a manipulation to be applied to said second plural- 



06/06/2002, EAST version: 1.03.0002 



5,392,071 

11 12 

ity of split streams of data, said second technique performing said manipulation upon said second plu- 

being different than said first technique; and rality of split streams of data; and 

data combiner means for combining said second plu- combining said second plurality of split streams of 

rality of split streams of data, as manipulated, into ^ 88 manipulated, into an output stream of data. 

an output stream of data. 5 ^ APP 2 *^ 33 claimed m claim wherein said data 

I* a \u j r • • * . 4f _ . sphtter means is operative to produce said first plurality 

11. A method of processing image data, said method £ ^ streams m a * ub w format> ^ d 

comprising the steps of: first reformatter means is operative to reformat said first 

generating a source stream of data representing an plurality of split streams of data to produce said second 

image; 10 plurality of split streams of data in a tiled format 

splitting said source stream of data into a first plural- 13. Apparatus as claimed in claim 1, wherein said first 
ity of split streams of data according to a first tech- reformatter means includes combining means for com- 
nique, each of said first plurality of split streams bining said first plurality of split streams of data to pro- 
representing a part of the information content of duce a combined data stream and means for splitting 
said source stream of data; 15 said combined data stream into a second plurality of 

reformatting said first plurality of split streams of data ^ stT fT ° f ?? to a second 

j , vL r 1_ r , A different than said first technique, 

into i a second plurahty of split streams of data ac- u A ^ ^ claimed m claim i, wherein ^ 

cording to a second technique different than said manipulation means is operative to perform video spe- 

first technique, said second technique being 2 o cial effect processmg on said second plurality of split 

matched to an image manipulation to be applied to streams of data, 

said second plurality of split streams of data; ***** 



25 



30 



35 



40 



45 



50 



55 



60 



65 



06/06/2002, EAST version: 1.03.0002 



